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Human Performance Modeling in Safety-Critical, 

Mixed-Initiative Domains 



• Focusing on evaluations of 
acceptability as well as optimality 

• Need to account for distributions of 
behavior 

• Tasks as the linkage for complex 
system evaluation 



• Increased use of automation emphasizes need for 
evaluation of attention 


Cognitive Modeling for Safety Critical, Mixed- 

Initiative Applications 

• Supporting Tradeoff Decisions 

-Social Penetration: Characterizing the problem space 

• Focus on evaluating the correct questions 

-Metricity: Avoiding the Illusion of precision 

• Applicability, Uncertainty 

- Robustness: Defining strategic variation 

- Data Applicability: Identifying the measurement 

needs 



Limitations: Bridging the Granularity Gap 





New architectures 

- Bounded Optimality - focus on the 
problems the human has 

— Strategy Generation - focus on how 

goals could be achieved, strategic 
variation ~ 
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Multi-tasking Strategy Space Analysis 



Device Task Duration (s) 
(Brumby, Howes, Salvucci, 2007) 


Limitations: Bridging the Granularity Gap 


New Tools for Domain Experts 


- CogTool 
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Frame Properties 






CogTool (John et al., 2004) 

New empirical measures 


- Focus on attention 

— eye tracking 

— fnirs images 

- EEG 
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Portable fNIRS 








Thank You 



Taxonomy 




ATTRIBUTE 

1 (LEAST) 

2 (MODERATE) 

3 (MOST) 

A 

DATA 

No basis in 

Describes 

Predicts 


APPLICABILITY 

existing data 

existing data 

future data 

B 

DIMENSIONALITY 

Single input 

Multi input. 

Multi input. 



single output 

single output 

multi output 

C 

METRICITY 

Limited to nominal 

Primarily ordinal 

Entirely cardinal 



relationships 

relationships 

relationships 

D 

ROBUSTNESS 

Unique focus on 

Moderate focus to 

Comprehensive 



limited objects 

a variety of objects 

of a wide slice 



or events 

or events 

of nature 

E 

SOCIAL 

Confined to a 

Communicated to 

Accepted and used 


PENETRATION 

mental model 

the relevant 

by the relevant) 




community 

community 


